CLAIMS 



What is claimed is: 

1 . A method comprising: 

identifying a plurality of motion classes for a frame of video data, each motion 
class having at least one region classified thereto; 

determining a region to be a poorly classified region 

forming a set of class hypotheses for the poorly classified region, the set of 
class hypotheses containing at least one possible motion class; 

determining a similarity measure for the poorly classified region with respect 
to a set of past and future video data, the similarity measure indicating a degree of 
similarity or consistency between a hypothesis for the motion of the poorly classified 
region and the motion of the corresponding regions in past and future frames; and 

reclassifying the poorly classified region to one of the at least one possible 
motion classes according to the similarity measure. 

2. The method of claim 1, wherein the set of past and future video data 
comprises: 

at least one preceding frame of video data; and 
at least one succeeding frame of video data. 

3. The method of claim 1, wherein reclassifying according to the similarity 
measure includes: 

determining which of the at least one possible motion classes are suitable for 
the poorly classified region using the similarity measure. 
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4. The method of claim 3 wherein reclassifying further includes: 
assigning the poorly classified region to a motion class of the at least one 

possible motion class with an optimal similarity measure. 

5. The method of claim 4, wherein the optimal similarity measure is a minimum 
similarity measure. 

6. The method of claim 1, wherein determining a region to be a poorly classified 
region comprises: 

measuring the distortion of a region; 

comparing the measured distortion of the region to a distortion threshold; and 
determining the region to be poorly classified if the measured prediction is 
greater than the prediction error threshold. 

7. The method of claim 1, wherein determining a region to be a poorly classified 

region comprises: 

measuring the prediction error of a region; 

comparing the measured prediction error of the region to a prediction error 
threshold; and 

determining the region to be poorly classified if the measured prediction is 
greater than the prediction error threshold. 

8. The method of claim 1, wherein the reclassification of a poorly classified 
region in an image comprises finding the minimum of a measure over all class 
hypotheses according to the equations arg Tmni(A(Ki)), where Ki is a class hypothesis, 
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indexed by A(Ki)=min(Apast(Ki), Apas^Ki)), Apast/fumre- —EE T>{K^'^ , ); Apast/future 

^ tB 

is a measure of the similarity/consistency through the distortion quantity, D, between 
a hypothetical class Ki and its corresponding class J^^^ on past/future frames. 

9. A computer-readable medium comprising computer program instructions 
which, when executed by a processor, cause the processor to perform they hypothesis 
algorithm comprising: 

identifying a plurality of motion classes for a frame of video data, each motion 
class having at least one region classified thereto; 

determining a region to be a poorly classified region 

forming a set of class hypotheses for the poorly classified region, the set of 
class hypotheses containing at least one possible motion class; 

determining a similarity measure for the poorly classified region with respect 
to a set of past and future video data, the similarity measure indicating a degree of 
similarity or consistency between a hypothesis for the motion of the poorly classified 
region and the motion of the corresponding regions in past and future firames; and 

reclassifying the poorly classified region to one of the at least one possible 
motion classes according to the similarity measure. 

10. The computer-readable medium of claim 9, wherein the set of past and future 
video data comprises: 

at least one preceding frame of video data; and 
at least one succeeding frame of video data. 
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11. The computer-readable medium of claim 9, wherein determining a region to 
be a poorly classified 

region comprises: 

measuring the distortion of a region; 

comparing the measured distortion of the region to a distortion threshold; and 
determining the region to be poorly classified if the measured prediction is 
greater than the prediction error threshold. 

12. The computer-readable mediimi of claim 9, wherein determining a region to 
be a poorly classified 

region comprises: 

measuring the prediction error of a region; 

comparing the measured prediction error of the region to a prediction error 
threshold; and 

determining the region to be poorly classified if the measured prediction is 
greater than the prediction error threshold. 

13. A video device comprising: 

means for forming a set of class hypotheses for a region of a ft^e of video 

data; 

means for determining a similarity measure for the region with respect to a set 
of past and future video data; and 

means for reclassifying the region according to the similarity measure. 
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14. The video device of claim 13, wherein the set of past and future data 
comprises: 

at least one preceding frame of video data; and 
at least one succeeding frame of video data. 

15. The video device of claim 13, further comprising: 

means for determining a region to be poorly classified by a) measuring the 
distortion of a region, b) comparing the measured distortion of the region to a 
distortion threshold, and c) determining the region to be poorly classified if the 
measured prediction is greater than the prediction error threshold. 

16. The video device of claim 13, further comprising: 

means for determining a region to be poorly classified by a) measuring the prediction 
error of a region, b) comparing the measured prediction error of the region to a 
prediction error threshold, and c) determining the region to be poorly classified if the 
measured prediction is greater than the prediction error threshold. 

17. A video device comprising: 

a motion compensation component configured to form a set of class 
hypotheses for a region of a frame of video data, to determine a similarity measure for 
the region with respect to a set of past and future data, and to reclassify the region 
according to the similarity measure. 
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18. The video device of claim 17, wherein the set of past and future data 
comprises: 

at least one preceding frame of video data; and 
at least one succeeding frame of video data. 

19. The video device of claim 17, wherein the region is reclassified by finding the 
minimum similarity measure and assigning the region to a class having the minimum 
similarity measure. 

20. A method comprising: 

performing motion estimation for a frame containing a plurality of motion 
classes, each motion class having at least one region classified thereto; 

identifying at least one poorly classified region; 

selecting a new motion class for each poorly classified region; 

reclassifying the poorly classified region to the new motion class; and 

re-estimating the poorly classified region based on a result of reclassifying the 
poorly classified region. 

21. The method of claim 20 wherein reclassifying includes: 

using a set of past and future data according to a hypothesis bracking 
algorithm. 
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